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ABSTRACT 


Likelihood  ratio  tests  for  the  problem:  H  :  F  c versus 

o  1 

Hp  F  6^-  are  defined  for  certain  nonparametr ic  families 

of  distributions  and  .  In  particular  the  likelihood 

ratio  test  is  defined  and  shown  to  be  unbiased  when 

denotes  the  exponential  distributions  (possibly  truncated) 
and  denotes  the  distributions  with  increasing  failure 
rate.  Comparisons  are  made  with  competing  tests.  The  problem 
of  testing  for  increasing  failure  rate  average  is  also 
examined. 


LIKELIHOOD  RATIO  TESTS  FOR  RESTRICTED  FAMILIES 


1 .  Introduct ion 

Tests  for  composite  hypotheses  having  optimal  properties  for  finite  samples 
have  been  obtained  for  various  special  problems  by  an  important  principle  due  to 
Neyman  and  Pearson  (1928,  1933)  called  the  likelihood  ratio  principle.  This  principle 
leads  to  the  likelihood  ratio  test.  Asymptotic  properties  of  this  test  for 
parametric  families  of  distributions  can  be  found  in  Wilks  (1962).  Recently 
a  conditional  likelihood  ratio  test  has  been  proposed  for  testing  for  trend  in  a 
stochastic  process  of  Poisson  type  [Boswell  (1966)].  This  is  a  departure  from 
the  standard  literature  in  that  the  underlying  family  of  distributions  considered 
is  essentially  nonparametr ic.  The  main  result  obtained  is  the  asymptotic  distribution 
of  the  likelihood  ratio  under  the  null  hypothesis  of  no  trend. 

We  consider  likelihood  ratio  tests  for  certain  geometrically  restricted 
families  of  distributions.  For  example,  let 

^  *  j  F  |  F(0)  *  0  and  P3-  -U_fl?)J  nondecreasing  in  x  >  oj  . 

Then  <*r  is  known  as  the  IFRA  (for  increasing  failure  rate  average)  family  of 
distributions.  These  distributions  play  an  important  role  in  the  mathematical 
theory  of  reliability  [Birnbaum,  Esary,  and  Marshall  (1966)].  However,  not  only 
is  the  family  nonparametr ic  but  there  is  no  sigma-finite  measure  relative  to  which 
all  F  e  are  absolutely  continuous.  Hence,  the  usual  concept  of  maximum 
likelihood  estimate  does  not  suffice.  Kiefer  and  Wolfowitz  (1956,  p.  893)  propose 
a  generalization  of  the  maximum  likelihood  estimate  concept  which  we  adopt.  Let 
F) ,  F2  €c^  and  let  f(-;  Fj ,  F2)  denote 


..  w.  r.' 


4 


2 


the  Radon-Nikodym  derivative  of  F^  with  respect  to  the  measure  induced  by  F^  + 
Definition  1 

^  A 

F  is  called  the  maximum  likelihood  estimate  relative  to  if  F  satisfies 


n 

sup  IT 
Fec^i  =  l 


f (X . ;  F,  F) 

1  -  f(X.;  F,  P)  =  1 


where  X  =  (X^  ,  X^,  X^)  is  a  random  sample  from  some  F  • 

This  definition  is  easily  seen  to  coincide  with  the  usual  definition  when  the 
family  is  dominated  by  a  sigma-finite  measure. 

Now  consider  the  problem  of  testing  Hq:  F  against  the  alternative 

A  ^ 

Hj  :  F  df-cTji  where  c  .  Let  F^  (F)  denote  the  maximum  likelihood 

estimate  relative  to  <5^  in  the  sense  of  definition  1.  We  define  the 

l  i ke  1  i hood  ratio  statistic  A  (X)  based  on  a  random  sample  X  as  follows: 

n  —  — 

Def in i t ion  2 

A^(X)  is  called  the  likelihood  ratio  statistic  where 

f  (X . ;  Fq,  F) 

1  -  f(X.;  p0,  f)_  ’ 

We  will  be  concerned  with  the  properties  of  Af1(X)  for  various  restricted 

fami lies  of  distribut ions  c  c?~  . 

0 

2.  IFRA  Distributions 

Let  c?0  =  {F  |  F(0)  =  0  and  ~.1o3  1  T  in  x  >  0}  and  X  *  (X]  ,  %2 , 

. X  )  denotes  a  random  sample  from  F  .  We  claim  that  the  maximum  likelihood 
n 


1 


3 


estimate  (MLE)  Fq  relative  to  c?  puts  mass  at  each  of  the  sample  observations. 

To  see  this  suppose  c?  =  {Fj  ,  F^  }  where  the  Fj  probability  of  the  observation 

X.  is  Fj{X.}  >  0  for  i  =  1,  2,  n  and  FjfX^}  =  0  for  some  k  (1  <  k  <  n)  . 

From  definition  1  it  follows  that  F,  is  MLE  in  c?  .  Since  F  can  put 

1  0 

mass  at  a  countable  number  of  points  we  may  restrict  attention  to  those  F  e 
putting  mass  at  sample  points;  i.e.,  F  absolutely  continuous  with  respect  to 
X  +  p  where  X  is  Lebesque  measure  and  p{A]  equals  the  number  of  sample 
points  in  A  .  The  likelihood  becomes 

n 

L  (X  I  F)  =  H  F  fX. }  . 
n  —  .  ,  i 

i  =  l 


Proschan  and  Marshall  (1967)  have  obtained  the  MLE  under  the  IFRA 
assumption.  From  the  definition  of  IFRA  d istr ibut iore we  see  that 


(2.1) 


Ln(X  |  F)  =  |exp(  -  XMX.)  -  exp( -  X.X.)] 


where  0  <  X  <  X,  <  ...  <  X  .  We  maximize  likelihood  subject  to  these  restrictions 

—  o  —  I  —  —  n 

by  letting  X  *  0  and  X  =  +®  .  Letting  A  X.  =  X.  -  X.  ,  where  X  = 

1  3  o  n  J  J  J-i  o 

and  X  «  +®  ,  we  see  that  (2.1)  becomes 
n 


n-l  r  n 

(2.2)  L  (X  |  F)  =  n  exp(-  A  X.  E  X.)  Cl  -  exp(-  A  \ ;X  ) ] 

n  "  i=l  L  '  i+1  J  11 


Maximizing  (2.2)  subject  to  A  X.  >  0  (1  <  i  <  n)  we  see  that 


0 


I 


(2.3)  4  t.  ■  r  flog  Z  X.  -  log  Z  X.  1  >  0 

1  Xi  L  i  J  i+t  J  J  " 


are  the  maximum  likelihood  estimates  of  A  X.(l  <  i  <n)  .  Substituting  (2.3) 
in  (2.2)  we  see  that  the  maximum  likelihood  according  to  definition  1  becomes 


(2.4) 


n-1  X. 

L(x  I  F)  =  n  1  -  — i- 
"  1  1-1  " 


If  we  let  c?t  denote  the  class  of  all  distributions  on  the  positive  axis,  then 

a. 

F  is  the  usual  empirical  distribution  function  and  the  likelihood  ratio  statistic 

for  testing  H  versus  H.  becomes 
3  o  1 


(2.5) 


n-1 
n  _ 
n  IT 


We  consider  the  test,  0  ,  which  rejects  when 


A_(X)  <  c 

n  —  —  (y 


where  c  is  determined  by 

O' 


pG  ;  si  ■  ° 
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and  G(x)  *  1  -  e"*  for  x  >  0  .  This  choice  of  a  test  based  on  the  likelihood 
ratio  statistic  is  motivated  by  the  following  theorem. 

Theorem  2.1 

The  test,  t  ,  based  on  the  likelihood  ratio  statistic  A  (X)  is  unbiased 

n  - 

at  all  significance  levels  for  the  problem 

Ho  ;  F  e^Q  =  fIFRA} 

versus 

H j  :  F  e^.  =  fOFRA)  . 


Proof: 

Let  G(x)  *  1  -  e’X  for  x  >  0  .  It  is  sufficient  to  show  that  F  etf 

—  o  o 

impl ies 


(2.6)  PQ  {/^(Y)  <  x}  >  Pp  f  A^X)  <  x) 

o 


and  Fj  e 


impl ies 


(2.7)  PQ  { An ( Y )  <  x]  <  Pp  f /^(X)  <x}  . 

Let  \|r(x)  *  G~Vq(x),  Y*  *  i|r  (X.)  and  note  ^  in  *  >  0  .  Also  Y.  is 

distributed  as  the  i -th  order  statistic  from  G  .  Now 


f(X  )  t(X  ) 

— —  <  ~x —  for  J  >  * 

'  j 

impl ies 


<•  v 


I 


.  ;■ 


1 


Since  h(x)  =  x  (! 


X. 

i 

n 


I  X. 


t(x . ) 

n 

T  *(X.) 

j-i  J 

is  increasing  in  x  (0  <  x  <  1) 


it  follows  that 


where  (Y.  <  Y_  <  . . .  <  Y  )  is  an  independent  ordered  sample  from  G  .  (2.6) 
I  ~  2.  —  —  n 

follows  immediately  and  th  proof  of  (2.7)  is  similar.  || 


We  say  that  F^  <  ( ? .e . ,  F^  is  starshaped  with  respect  to  F^)  if 

Fj'f^x) 

- - -  is  nondecreasing  for  x  >  0  .  From  the  proof  of  theorem  2.1  it  follows 

that  Fj  F?  impl  ies 


K®  -  cJ ;  pf2  K® ;  • 


Hence  the  power  of  the  likelihood  ratio  test  is  greater  at  F^  than  at  F^  when 
^1  ^  ^2  '  ^ercenta9e  points  for  -log  An(X)  are  given  in  Table  1. 

Of  course  there  are  many  unbiased  tests  of  the  IFRA  hypothesis.  Marshall, 
Walkup  and  Wets  (1966)  have  characterized  the  class  of  all  such  tests.  These  are 
just  the  tests  based  on  functions  f(x^  ,  )  having  the  properties: 

1)  f  is  homogenous; 

2)  Z  x.  df*V  X2 . xn*  >0  for  j  -  1,  2 . n-1 

i=l  1  dx.  and  all 

x,  >  x_  >  . . .  >  x  >  0  . 
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The  test  associated  with  f  would  reject  H  if 

J  o 

f (X i  »  x2  *  ••• .  xn)  >  c 

where  c  is  some  suitable  critical  number  and  X,  >  X„  >  ...  >  X  are  the 

1  —  2  —  —  n 

usual  order  statistics  labelled  in  reverse  order. 

3.  IFR  Distributions 

Let  c?  =  {F  |  F(0)  =  0  and  -  log  [1  -  F(x)]  is  convex  for  x  >  0}  .  This 
is  the  class  of  IFR  (for  increasing  failure  rate)  distributions.  Proschan  and 
Pyke  (1965)  have  proposed  a  t"'*1-  for  constant  versus  increasing  failure  rate. 

Their  test  is  based  on  a  statistic  considered  by  M.  G.  Kendall  (1938)  and 
H.  B.  Mann  (19^5)  and  is  essentially  a  rank  test  for  trend.  Proschan  and  Pyke 
show  that  their  test  is  unbiased,  has  good  large  sample  properties,  and  is  competitive 
in  this  sense  with  certain  parametric  tests  when  the  unknown  distribution  lies 
within  some  specified  parametric  family.  However,  sampling  experiments  indicate 
that  their  test  does  not  have  good  discriminating  power  for  relatively  small 
samples.  This  is  perhaps  to  be  expected  since  their  test  does  not  use  all  of  the 
information  in  the  sample. 

M.  Boswell  (1986)  studied  a  similar  problem  concerning  Poisson  type  processes. 

4 

His  statistic  based  on  a  conditional  maximum  likelihood  ratio  test  is  essentially 
the  same  as  the  likelihood  ratio  statistic  studied  in  this  section.  The  main 
result  in  Boswell's  paper  is  a  derivation  of  the  asymptotic  distribution  of  his 
test  statistic.  In  contrast,  we  concentrate  on  small  sample  results. 

Since  IFR  distributions  can  have  a  jump  at  the  right  hand  end  of  their 
interval  of  support  it  is  clear  from  definition  1  that  we  need  only  consider 


8 


estimators  absolutely  continuous  with  respect  to  Lebesgue  measure  on  [0,  X  ) 


with  a  jump  at  (see  Barlow  and  Proschan,  (1965).  p.  26).  Hence 


•  n-1 

Ln(i  I  F)  =  TT  f(X.) 
L  i*l 


where  f  is  the  density  of  F  on  fO,  X  )  .  Since 


1  -  F(x)  *  exp 


x 

/■ 


(u)du 


where  r(u)  *  f(u)/fl  -  F(u)] 


for  0  <  u  <  X^  ,  we  may  write 


f(x)  -  r(x)  e 


x 

/ 

-  o 


y*  r(u)du 


0  <  x  <  X 


and 


F{*„}  ■  • 


J  r(u)du 


-  o 


Hence 


n-1 


(3.1)  log  L  (X  |  F)  «  I  log  r(X 

M 


h 

i>  -  s  J  r 

'  i*l  J 


(u)du 


The  problem  of  maximizing  (3.1)  subject  to  r(x)  nondecreasing  was  solved  by 
Grenander  (1958)  and  independently  by  Marshall  and  Proschan  (1965).  They  show 
that  the  problem  can  be  reduced  to  maximizing 
n-1  n-1 

E  log  r (X . )  -  Z  (n  -  i)  (X.+.  -  X.)  r(X.) 
i-1  '  i=l  ,+l  1  ' 


subject  to  r(X.)  <  r(X  )  <  ...  <  r(X  ,)  .  The  maximum  likelihood  estimates  are 
l  ~  i  —  -  n-1 


T 


9 


fn<V  *  v"i;,  “  [("-“Hxut1:  T)  In.,,)^,)] 


for  i*l,2,  ...,n-l  .  The  maximum  likelihood  is 


(3.2) 


"n-1 

-n(x  |  F)  -  TT  r(X 
Li  =  l 


-(n  -  1) 


The  exponent  on  e  can  be  easily  verified  using  the  definition  of  r  and  observing 
that 

X. 


A,  A,  . 

Z.J  r(u)du  -  £  <n  ‘  ]  J  f(u)du  ' 

0  X. 


Let  <sr  -  {F  |  F(0)  *  0,  F(x)  *  1  -  e‘Xx  for  x  <T  and  F(T)  «  1  ,  X  >  0,  T  >  0) 


Then  denotes  the  class  of  exponential  distributions  with  possible  truncation 

on  the  right.  Consider  now  the  problem  of  testing  Hq:  F  e-?o  versus 

H  •  F  e<5- «  The  choice  of  H  was  determined  by  the  fact  that  the  MLE's 
I  o  o 

A  A 

Fq  and  F  are  both  absolutely  continuous  with  respect  to  Lebesgue  measure  in 

[0,  X  )  and  place  mass  at  X  .  The  likelihood  under  H  will  be 
1  n  n  o 


L„<i  I  Fo> 


n-1 

TT 

L  •*! 


-XX. 
e  n 


and  the  maximum  likelihood  will  be 
(3.3)  Ln(X  |  Fo)  = 


n-1 


-n 


According  to  definition  2,  the  likelihood  ratio  statistic  for  testing  for 
truncated  exponent  i  a  lity  versus  IFR  and  not  truncated  exponent  ial  i  ty  will  be 


» 


10 


(3.4)  A^  (X) 


(P  T  0 


n-1 


\  n-1  n-1 

rx,  TT  «x.) 


If 


1 


I 


<  ...  <  1 


(n  -  l)(X2-  X,)  "  (n  -  2)(X3-  Xj)  ~  (Xn-  X^) 


so  that 


-  /  v  \  _  1  i*l,2,  . . . ,  n  -  1  , 

r(Xi}  T —  3)(xi+1- y.) 


then  (3.4)  becomes 


n-1 


*  * .  . 

\  <*> 


n-1 

I  I  (n 

i-1 


0(xi+r  X.) 


As  in  section  2  we  consider  the  test,  cp  ,  which  rejects  Hq  when 


Tf  .  , 

<*>  ^  «„ 


where  c  is  determined  by 
a 

pr  O'!  (Y)  <  c  }  -  ®  . 

bn  —  —  <y 

The  asymptotic  distribution  of  A  (Y)  car,  be  found  in  Boswell  (1966,  p.  1572). 

n 

A  table  of  percentage  points  obtained  using  Monte  Carlo  methods  is  contained  in 
Table  2. 

4.  Unbiasedness  of  the  Likelihood  Ratio  Test  for  IFR 

Like  the  Proschan-Pyke  test,  the  likelihood  ratio  test  has  greater  power 
under  the  alternative  than  under  the  null  hypothesis.  To  show  this  we  need  to 
introduce  some  auxilliary  results. 


n 


n  i 

Given  a  sequence  of  nonnegative  real  numbers  fz.}  ,  plot  E  z.  versus 

'  i*l  1  J 

i  and  interpolate  linearly  between  (0,  0),  (1,  z,),  ...  (n,  z,  +  ...  +  z  )  . 

I  I  n 

Let  Zj  >  z2  >  ...  >  zp  denote  the  slopes  of  the  least  concave  majorant  to  this 

graph  in  successive  intervals.  This  operation  converts  the  original  sequence  into 

a  nonincreasing  sequence  and  will  be  useful  later  on.  For  convenience,  call 

z,  >  z_  >  ...  >  z  the  Brunkized  sequence  after  D.  Brunk  (see  0.  Brunk  et.  al. 
i  -  i  —  —  n 

(1955)).  Note  that  z,  >  z„  >  ...  >  z  can  also  be  obtained  by  successive 

I  —  z  —  —  n 

averaging  of  the  original  sequence  until  it  becomes  non  increasing. 

We  say  that  H(z,  ,  z„ ,  ....  z  )  is  a  Schur  function  if 
I  2  n  — — — 


z.) 

J 


>  0 


for  all  vectors  z  and  i,  j  *  1,  2 .  n  .  This  concept  is  needed  in  the 

* 

following  useful  lemma. 


Lemma  1 

Let  (z,  ,  z„ ,  ...,  z  )  and  (z.  ,  z_ ,  ...,  z  )  denote  two  nonnegative 
12  n  12  n 

sequences  such  that 


and 


£  z .  >  E  z 

1  1  "  1 


n  n  , 

E  z,  ■  E  z.  . 
1  '  1 


for  r=l,2,...,n-l 


Then  the  inequalities  are  preserved  under  Brunkizat ion; 


i  .e. , 


(i) 


r  _  r  -r 

E  z .  >  E  z . 
i  =  l  1  i=l  1 


E  z.  =  E  z. 
i=l  i=l 


(r  =  1 ,  2,  . . .  ,  n  -  1) 


If  H  is  a  Schur  function  then 


_  _  _  II  I 

(ii)  H(z^,  ^2’  • • • »  ^  ^(Zj i  ^2*  “ ' ’  z3^ 


Proof: 


(i)  is  obvious  since  the  least  concave  majorant  to  the  {z.}  sequence 

i 

lies  above  the  least  concave  majorant  to  the  {z.}  sequence. 

__  “T  '  "T  n  _  n  — r 

Since  (i)  holds,  z,  >  z.  >  ...  >  z  ’,  z,  >  ...  >  z  and  E  z.  *  E  z 

1—7—  -  n  1  —  —  n  i 


1  1  1  1 


we  have  (ii)  by  the  Schur,  Ostrowski  theorem  (see  Ostrowski  (1952)).  // 
Theorem  4. 1 

If  G  V(x)  is  convex  for  x  >  0,  G(0)  *  F(0)  ■  0  and  X  (Y)  denotes  a 
random  sample  from  F ( G )  ,  then 


12 


4 


An  (X)  <  A”  (Y) 
n  st  " 


Remark 

•k 

This  proves  the  likelihood  ratio  test  A  is  unbiased  since  if  F  is  IFR 

n 

and  G(x)  =  1  -  e  for  x  >  0  ,  then  G  F  is  convex  on  x  >  0  . 


Proof: 


Y*  =  G_1F(X.)  and  note  yV  =  Y.  . 
i  i  i  st  i 


i 


Let 
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Let 


z .  = 


(n  -  i)(X.+)-  X.) 
n-l 

T  (n  -  i)(Xi+,-  X.) 


and 


z .  = 


("  -  iXVr  y? 

<"  -  *><*?♦!  - y? 


*v  .  ]  mm] 

Since  Y.  =  G  F (X . )  and  G  F  is  convex 


<"  -  V 

("  -  'HXi+r  xi> 


is  increasing  in  i  *  1,  2,  ....  n  .  It  follows  from  lemma  3-7  (•)  of  Barlow 
and  Proschan  (1966)  that 


y  2. 

j _ 

r 

T.  z. 
1  1 


n-l  , 
T  z. 

1  1 


—  n-l 


T  z. 


=  1 


and  hence  Y  z .  >  I  z .  for  r  =  1,2,...,  n-l.  Let  {z . ]  and  fz .  ]  denote  the 
1  1  -  ,  1  1  1 

I 

Brunkized  estimates  of  (z.)  and  fz.}  respectively.  Let 

n-l 

-H(xr  x2,  ....  xn_,)  =  TT  x. 

i  =  l 


.  » 

and  note  that  H  is  a  Schur  function.  Since  fz.}  and  fz.}  satisfy  the 

1  1  1  1 

hypotheses  of  lemma  1,  it  follows  that 


r 
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V  2 


n  - 1  —  I  2 


Hence 

(4.1) 


"n-1 

1 

C 

1 

c 

T.  (n  -  i )  (X .  —  X.) 

_  1  ’  . 

FT  f(X  ) 

1 

•••»  z  .)  • 
n-1 

1 

"n  - 1 

n-1  n-1 

t.  (n-i)(v:;,v:) 

TT  r(YV) 

l  1 

S  i  nee 


r  n 

:  (n  -  » )  (YV  -  Y'.)  Y  Y%: 

0 _ _  J _ _ 

r  —  n 

I  (n  -  i )  (X  -  X.)  v  X. 

0  1+1  1  1  1 


for  (1  ^  r  <  n  -  l)  by  lemma  3-7  (i1)  of  Barlow  and  Proschan  (1966)  it  follows  that 
n-1  n-1 


(4.2) 


T.  (n  -  i )  (X  -  X  ) 
1  11 


Z  X. 


T.  (n  -  i)(Y  -  Y  ) 
1  111 


z  y: 


(4.1)  and  (4.2)  together  imply 


a"(x)  <  a2(y“) 

n  —  —  n  — 


The  theorem  follov/s  from  (Y,,  Y  ,  ...,  Y  )  =  (Y.,  Y_  ,  ...,  Y  )  .  // 

l  n  s  t  I  i  n 


Marshal  1  ,Wal  kup  and  Wets  ( 1 966 )  have  characterized  the  class  of  unbiased 

tests  for  constant  failure  rate  versus  nondecreasing  failure  rate.  These  are 

based  on  functions  h(x.,  x„ ,  ....  x  )  satisfying  the  conditions 

2  n 
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i) 

ii) 


h  is  homogeneous ; 


J 

T. 

i  =  l 


(*:• 


V 


*h(x 


1  ’ 


x  ) 

n 


nx. 


>  0 


2)  •  •  • y  n  •  1 


for  all  Xj  ^  x2  ^  >  xn  >  ®  •  The  corresponding  test  consists  of  rejecting 

exponent ia 1  i ty  if  h (X ^  ,  X^,  ....  X^)  <  c  where  c  is  a  suitable  critical  number 
and  X,  >  X„  >  ...  >  X  are  the  order  statistics  labelled  in  reverse  order. 

5.  Distribution  of  the  Maximum  Likelihood  Ratio  Statistic  Under  the  Exponential 
Assumpt ion 

From  the  computations  in  Boswell  (1966)  it  is  clear  that  the  distribution  of 

A  ,  even  under  the  null  hypothesis,  is  exceedingly  complicated.  For  this  reason 
n 

we  have  had  to  use  Monte  Carlo  methods  to  obtain  the  percentage  points  tabulated 
in  Table  2.  However,  the  distribution  of  A  under  is  quite  smooth 

as  we  show  in 

Theorem  5- 1 

The  likelihood  ratio  statistic 
under  the  exponential  assumption. 

Proof : 

Let  0  =  W.  <  W.  <  ...  <  W  denote  an  ordered  sample  from  the  uniform 

—  u  —  I  —  —  n 

distribution  on  (0,  1)  .  Let 

U.  *  W.  -  W.  j  i=l,2 . n-1. 


A^  has  a  nonincreasing  density  on  (0,  l) 


t 
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Then  the  random  vector  (U.,  iL,  ....  U  ,)  has  joint  density 

12  n  -  I 


h(iJ|,  ^2*  •••*  j ) 


(n-l ) !  for  u.  >  0 

i  — 


i  =1,2,..., n-l 

0<u,+U-+...+u  ,<1 

—  1  2  n-l  — 

otherwise. 


Let  (U, ,  IL . U  ,)  denote  the  modified  vector  (U, ,  UL ,  ....  U  ,)  after 

12  n-l  12  n-l 

Brunkizat ion  and  subject  to  Uj  >  IL  >  . . .  >  i  • 

The  likelihood  ratio  statistic 


•*,  v-i  '-I 


IT  r(V.) 


is  distributed  as  (n  -  l)n  TT  under  the  exponential  assumption.  Notationally 

1  1 

it  will  be  convenient  to  replace  n-l  by  n  .  Hence  we  need  only  prove  that 


(  n  1 
P  TT  U.  <  z 


is  concave  in  z  e  (0,  l)  .  Let  I  denote  the  usual  indicator  set  function  and 


observe  that 


TT  U.  <  z  1  -  r\l  f f  ...  f  |  fu,  ...  u  <  z] 

1-1  I  JJ  1 


du,  ...  du 

n 


0<u,+. .+u  <1 
-  1  n- 
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Integrating  out  on  u  we  have 

n 


p|tt  f(v 


u  .>0 
i  — 

u,+...+u  ,<! 

1  n- 1- 


•  •  f  u  .  i  z ) du>  •  •  •  du  * 
n-2  I  n  - 1 


where 


f  ( u .  i  ....  u  ;  z)  =  /  I  ru,...un  <  z]du 

•  n  -  I  n  .  ^  1  . .  . .  ^ 


(Ku  <1  -u,  .  -u  , 
-  n-  1  n-1 


=  min  [l  -  u,  -  ...  -  u  u  (z)l 
L  1  n-1  n  J 


and  u  (z)  is  the  solution  of  z  =  u,  ...  u  ,  u 
n  I  n  - 1  n 

for  fixed  u,  ,  u„ . u  .  . 

12  n-1 

We  claim  that  z  is  a  strictly  increasing  convex  function  of  un  and, 

therefore,  that  u^  is  a  strictly  increasing  concave  function  of  z  .  It  follows 

that  f(u, ,  ....  u  z)  is  a  concave  function  of  z  for  fixed  (u. ,  u« ,  ..,  u 

I  n  - 1  l  z  n  - 1 

Hence 


If* 


f (u, . u  ,  ;  z)du,  ...  du  , 

I  n-l  i  n-l 


is  a  concave  function  of  z  . 
To  show  z  =  u 


1 


u  ,  u  is  a  convex  function  of  u  ,  define 
n- 1  n  n 


(u,  ,  ....  u  ,)  to  be  the  Brunk  modification  of  (u, ,  u  ,  ....  u  ,)  subject 
I  n-l  I  2  n-l 


to  u,  >  u»  >  . . .  >  u  . 
i  -  L  —  —  n-l 


Clearly  z  is  piecewise  convex  for  u  in  the 


intervals  r0,  u  „ 1,  u  u  ,1,  ...,  1  -  u.  -  ...  -  u  ,,  u.  n  .  It  is 

n-2  ■  n-2  n - }  '  ■  n-l  I  - 

therefore  sufficient  to  show  that  z  has  a  continuous  derivative  in  u  .  We  show 

n 

.1,  J. 

that  the  right  and  left  hand  derivatives  at  un  =  u^j  are  equal.  For  un  <  u^ 
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.  ui  ^ 

f 


...  /u.  .  -  +  ...+U  ,\  n-j-1 

s:  ...  r;  j*1  ,  . 

du  I  J  \  n-l-j  / 


For  u  .  <  u  <  u  „ 
n-1  n  n-2 


dz 

du 


-*  /Ui+l  +  ’*'+un\  n'j-' 

„  '  j  \  n~j  / 


For  u  =  u  ,  ,  obviously 
n  n-1 


/u.  ,+. . .+U  V 

/  J-H  n-1 

/u.  ,,  +  ... +u  ,+u  \ 
1  i  +  l  n-1  n\ 

1 

1 

c 

- » 

1 

c 

For  n  =  2  and  n  =  3  it  is  a  straightforward  computation  to  obtain  the 

distribution  of  A  ( Y )  .  Clearly,  for  n  *  2 
n  ~ 


a^(y) 


u 


and  the  likelihood  ratio  is  uniformly  distributed  on  (0,  l)  . 
For  n  *  3 


A^(Y)  =  4  ~1  “2 


Hence 


PG  |  ^3  (-}  <u|  '  SSl  u 


|UlU2^*»i 


ul-  u2 


du^  du^  + 


_CL 

IV 

nT 

04 

if  u,  <  u2 

//  ^ 

du,  du2 

u,+u2<  vTuj 

ul—  u2  1 

and 
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i 


The  density  is 


g^u)  =  i  +  i  log 


1  +  /Uj  ' 
u 


It  is  easy  to  check  that  g 

I  I 

93(0)  *  93(1 )  *  "  “  "  !t  is 

in  general,  i.e.,  gn(0)  =  + 


is  decreasing,  g^ ( 0)  =  +  «#,  g^(l)  =  ^  and 
tempting  to  conjecture  that  this  behavior  is 

I  I 

®,  gn(0)  =  gn ( 1 )  =  -  oc  for  n  >  3  • 


true 


I 
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6 .  Comparisons  with  Competing  Tests 

In  a  paper  in  process  (Barlow  and  Jacobson)  we  study  in  some  detail  the 

robustness  of  the  IFRA  and  I F R  likelihood  ratio  tests  relative  to  selected  competing 

tests.  Preliminary  investigations  indicate  that  the  IFR  likelihood  ratio  test  is 

much  better  than  the  Proschan-Pyke  test  for  small  samples.  However,  they  have 

achieved  a  remarkable  amount  of  information  concerning  the  asymptotic  behavior  of 

their  test  statistic.  In  particular  they  show  that  their  test  statistic,  suitably 

normalized,  has  an  asymptotic  normal  distribution  for  a  wide  class  of  alternative 

d  ist r  i  but i ons .  On  the  other  hand,  the  distribution  of  the  IFR  1 i ke 1 i hood  ratio 

2 

statistic,  under  the  null  hypothesis,  converges  to  a  weighted  sum  of  x  distributions 

which  is  rather  cumbersome  to  compute.  For  small  sample  sizes  (say  n  <  10)  both 

statistics  are  relatively  easy  to  compute  with  the  aid  of  a  desk  calculator. 

Figure  1  is  a  graph  of  the  power  functions  for  both  tests  against  Weibull 

-(>x)0' 

distribution  alternatives  (i.e.,  F(x)  =  1  -  e  for  x  >  0  where  ry  is 

the  shape  parameter)  when  the  sample  size  is  10  and  the  significance  level  is 

5%.  These  curves  were  obtained  by  means  of  Monte  Carlo  simulation  on  a  computer. 

The  power  of  the  Proschan-Pyke  test  increases  very  slowly  as  a  function  of  the 

Weibull  shape  parameter,  <y  .  Even  when  the  shape  parameter  o  =  3  .  the  power  is 

only  .62.  Our  numerical  invest i ga ions  indicate  that  for  o  >  3  the  power  increases 

even  more  slowly  and  that  for  =  500  ,  the  power  is  only  .86.  For  n  =  20  , 

the  power  of  the  Proschan-Pyke  test  is  much  better;  it  yields  a  power  of  .92  for 

o'  =  3  •  It  should  be  noted,  however,  that  the  power  of  this  test  is  still  not  as 

good  as  the  power  of  the  likelihood  ratio  test  when  n  =  10  . 

The  asymptotic  relative  efficiency  of  the  Proschan-Pyke  test  relative  to  the 

Weibull  likelihood  ratio  test  when  the  true  distribution  is  of  the  form  G(x)  = 

-(x)a 

1  -  e  (o  >  1 )  for  x  >  0  was  computed  to  be  .59  (see  Proschan-Pyke  (19&5)). 

The  asymptotic  relative  efficiency  of  their  test  relative  to  the  gamma  likelihood 


i 
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ratio  test  when  the  true  distribution  is  the  gamma  is  only  .20.  Unfortunately, 
asymptotic  evaluation  of  the  IFR  likelihood  ratio  test  seems  to  be  extremely  difficult. 

There  are  many  additional  unbiased  tests  of  exponent i a  I i ty  versus  IFRA  or 
IFR  which  should  perhaps  be  considered.  Recall  that  all  of  the  associated 
statistics  are  necessarily  homogeneous.  A  statistic  related  to  the  IFR  likelihood 
rat !o  statistic  is 


C" 


i  +  1)  (X.  -  xUI) 


If  there  are  no  reversals  of  the  normalized  differences  (they  should  decrease  under 

IFR  alternatives)  then  A  and  *,  agree  except  for  the  factor  n  X  and  a 

n  n  I 

constant.  If  G  '  F  is  convex,  then 


(X)  1  A 

st 


n 


(V)  • 


The  test  which  rejects  exponent ia 1 i ty  when  (X)  is  sufficiently  large  is  related 

to  a  test  derived  by  Moran  (1951)  for  a  problem  concerning  renewal  processes.  Under 
the  assumption  of  exponent  i a  1  i ty 

-2  log  A'"'(Y) 

W  =  — : - 7 - 

1  +  n+ 1 

57 r 

2 

is  asymptotically  distributed  as  a  X  variable  with  n  -  1  degrees  of  freedom. 
Epstein's  (i960)  test  8  uses  this  statistic.  Monte  Carlo  experiments  by  Zelen 
(i960  indicate  that  the  power  of  this  test  is  less  than  that  of  the  Proschan-Pyke 
test  for  small  samples  against  Weibull  distribution  alternatives. 

In  section  2  we  proved  that  F  <  G  implies 


t 
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\  (x)  >  A  (v)  • 
n  -  s-  n  - 


Hence  we  could  consider  the  test,  c  ,  which  rejects  exponent  i  a  1 i ty  in  favor  of 
the  IFRA  hypothesis  when  A  (X)  >  c,  where 

P_  |a  (V)  >  c.  I  *  1  -  Pr  1  A  (Y)  <  c.  1  =  0. 

G  |  n  -  -  1  --v  j  G  |  n  -  -  1  -a  j 

For  this  test  we  would  use  the  upper  percentile  points  of  -log  An(X)  given  in 

Table  1.  Since  A  (X)  is  essentially  the  maximum  likelihood  under  the  IFRA 

n  — 

assumption  it  is  perhaps  not  too  surprising  that  it  seems  superior  to  the  IFR 
likelihood  ratio  test  (see  Fig.  l).  On  the  basis  of  computer  calculations  we 
conjecture  that  -log  An(Y),  suitably  norma  1 i zed,  i s  asymptotically  N(0,  l)  . 

Perhaps  a  better  test  than  all  ol  those  considered  so  far  is  a  un i form 
conditional  test  [see  Cox  and  Lewis  (1966)  p.  153]  based  on  the  mean  of  the 
rectangular  distribution.  This  has  been  described  by  Bartholomew  as  the  oldest 
known  statistical  test  [see  discussion  in  Cox  (1955)]-  Epstein  ( 1 960 )  adapted  this 
test  to  the  life  testing  problem  and  called  it  test  3-  The  test  is  based  on  the 

total  time  on  test  up  to  the  i -th  order  statistic  (i  =  1,  2 . n) ,  i.e., 

i 

T  (X.)  =  Z  (n  -  j  +  1)  (X.  -  X  )  . 

1  j=l  J  J 

n  -1  n 

The  test  statistic  is  Z  T(X.)/  Z  X.  .  Under  the  exponential  hypothesis 


i=  I 


1 


Z  = 


n-l  /  i\  n 

Z  T (X . )  -  £  x. 

1  1  2  1  1 

z  x.  ToT  -  1 ) / 1 2 


T 


is  approx i mate  1 y  N(0,  l)  even  for  relatively  small  n  .  If  F  <  G  ,  then  it 
follows  from  Theorem  3-12  (iii)  Barlow  and  Proschan  (1966)]  that 

n  -I  n  - 1 

7  T(X. )  T  T ( Y . ) 

1  ,  1 


Hence  a  natural  test,  rr  ,  rejects  exponent  i  a  1  i  ty  in 

n-1  T (X  . ) 

favor  of  IFRA  if  T.  - - —  >  c 

!  0 

jn-1 

where  P  ,  :  T(Y 

G  I  1 

Empirical  sampling  by  Zelen  and  Dannemiller  [(1961),  p.  47]  indicates  that  this 
test  is  superior  to  against  Weibull  distribution  alternatives.  Investigations 

by  Cox  (1955)  show  that  the  analogue  of  this  test  for  randomness  in  a  seguence 
of  events  is  the  most  powerful  test  of  the  Poisson  hypothesis  against  the  alternative 
of  a  t i me -dependent  Poisson  process  with  occurrence  rate 

>(t)  -  e0-*6'  . 

See  Bartholomew  (1956)  for  further  results  concerning  this  test. 

7 •  Concluding  Remarks 

It  is  perhaps  worth  noting  that  the  percentage  points  in  Table  2  and  the  results 
of  section5elso  apply  to  the  Boswell  test  for  trend  in  a  stochastic  process  of 


;)/ 


Y.  >  c 


L 


1  — 


Poisson  type.  However,  if  the  sample  size  is  n  and  one  is  using  the  Boswell 
statistic  then  one  should  locate  percentage  points  in  Table  2  corresponding  to 
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the  number  n  +  1  .  A  proof  for  unbiasedness  of  the  Boswell  test  can  be  made, 
patterned  after  the  techniques  of  section  4. 

The  number  of  possible  likelihood  ratio  tests  which  may  be  constructed  using 
the  definitions  in  section  1  is  fairly  large.  Recall  that  the  DFR  (for  decreasing 
failure  rate)  maximum  likelihood  estimate  is  absolutely  continuous  when  F(0)  =  0 
Marshall  and  Proschan  (1965)]-  Hence  one  can  construct  a  likelihood  ratio  test 
for  the  following  problems: 


(1) 


versus 


Hq!  F  a  truncated  exponential 
H  :  F  DFR  and  then  IFR  (F(0)  =  0) 


versus 


Ho:  F 


V  F 


IFR 

DFR  and  then  IFR  (F(0)  =  0)  . 


Note  that  the  maximum  likelihood  estimates  under  both  the  hypothesis  and  the 

alternative  in  each  case  will  be  absolutely  continuous  except  at  the  largest 

observation,  X  ,  i f  we  impose  the  additional  restriction  F ( 0 )  =  0  . 
n 

Clearly  we  can  also  construct  a  maximum  likelihood  test  for 


H  :  F  truncated  DFR 

(3)  versus 

Hj :  F  DFR  and  then  IFR. 

There  is  no  difficulty  in  constructing  maximum  likelihood  tests  for  the  problems: 

H^:  F  exponential 

(4)  versus 

H  :  F  DFR  (F(0)  =  0) 

and 

H0:  F  DFR  (F(0)  =  0) 

(5)  versus 

H^:  F  has  decreasing  density  ( F ( 0)  =  0). 
and  F  not  DFR 


26 


The  maximum  likelihood 
(1956).  Recall  that  i 
L ikel  ihood  ratio 
subsequent  paper. 


estimate  assuming  a  decreasing  density  is  given  by 
f  F  is  DFR,  then  it  has  a  decreasing  density, 
tests  for  the  two  sample  problem  will  be  considered 


Grenander 


i  n  a 


20,000  Random  Simulations 
for  Each  Point 


Fig.  1.  Power  comparison  of  IFR  likelihood  ratio  test,  Proschan -Pyke  test  and 
Weibull  distribution  alternatives.  (»  is  the  Weibull  shape  parameter.) 
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